Estimation of an Entropy-based Functional
نویسندگان
چکیده
منابع مشابه
Estimation of an Entropy-based Functional
Given a function f from [0, 1] to the real line, we consider the (nonlinear) functional h obtained by evaluating the continuous entropy of the “density function” of f . Motivated by an application in signal processing, we wish to estimate h(f). Our main tool is a decomposition of h into two terms, which each have favorable scaling properties. We show that, if functions f and g satisfy a regular...
متن کاملOn the Estimation of Shannon Entropy
Shannon entropy is increasingly used in many applications. In this article, an estimator of the entropy of a continuous random variable is proposed. Consistency and scale invariance of variance and mean squared error of the proposed estimator is proved and then comparisons are made with Vasicek's (1976), van Es (1992), Ebrahimi et al. (1994) and Correa (1995) entropy estimators. A simulation st...
متن کاملAn Estimation of Distribution Algorithm Based on Maximum Entropy
Estimation of distribution algorithms (EDA) are similar to genetic algorithms except that they replace crossover and mutation with sampling from an estimated probability distribution. We develop a framework for estimation of distribution algorithms based on the principle of maximum entropy and the conservation of schema frequencies. An algorithm of this type gives better performance than a stan...
متن کاملMultivariate Edgeworth-based Entropy Estimation
We develop the general, multivariate case of the Edgeworth approximation of differential entropy, and introduce an approximate formula for Gaussian mixture densities. We use these entropy approximations in a new algorithm for selecting the optimal number of clusters in a data set, and in a new mutual information test with which one can statistically decide whether a distribution can be factoriz...
متن کاملNonparametric entropy estimation : an overview ∗
We assume that H(f) is well-defined and is finite. The concept of differential entropy was introduced in Shannon’s original paper ([55]). Since then, entropy has been of great theoretical and applied interest. The basic properties ∗This research was supported by the Scientific Exchange Program between the Belgian Academy of Sciences and the Hungarian Academy of Sciences in the field of Mathemat...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Entropy
سال: 2010
ISSN: 1099-4300
DOI: 10.3390/e12030338